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Abstract. Stochastic differential games are considered in a non-Markovian setting. Typically, in 
stochastic differential games the modulating process of the diffusion equation describing the state flow 
is taken to be Markovian. Then Nash equilibria or other types of solution such as Pareto equilibria are 
constructed using Hamilton-Jacobi-Bellman (HJB) equations. But in a non-Markovian setting the 
HJB method is not applicable. To examine the non-Markovian case, this paper considers the situation 
in which the modulating process is a fractional Brownian motion. Fractional noise calculus is used 
for such models to find the Nash equilibria explicitly. Although fractional Brownian motion is taken 
as the modulating process because of its versatility in modeling in the fields of finance and networks, 
the approach in this paper has the merit of being applicable to more general Gaussian stochastic 
differential games with only slight conceptual modifications. This work has applications in finance 
to stock price modeling which incorporates the effect of institutional investors, and to stochastic 
differential portfolio games in markets in which the stock prices follow diffusions modulated with 
fractional Brownian motion. 
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1. Introduction. The study of stochastic differential games with controls is a 
part of game theory that is relatively unknown, even though it has significant potential 
for application as noted by 0ksendal and Reikvam [211 • Prior work in this area has 
focused on the examination of such games in a Markovian setting (see below). In 
this paper we will study a type of non-Markovian stochastic differential game. In 
particular, we will consider a game in which the one-dimensional state Xt follows the 
following stochastic differential equation: 

( H ] 

dXt ^ fi{t,Xt,vi, ...,VN)dt + a{t,Xt,vi, ...,VN)dBl (1.1) 



A* : [0, T] X H X Ti X ... X Tn ^ M, (1.2) 



cr : [0, T] X M X Ti X ... X Tn ^ M, (1.3) 

where Vi G C IR'^' is the control of the ith player over the state and is adapted 
to the natural filtration of . Here T is the expiration date of the game, and B^ 
is a fractional Brownian motion (fBm) with Hurst parameter H G (5,1)- is 
defined as an almost surely (a.s.) continuous zero mean Gaussian process having the 
autocorrelation structure given by 

i?{sfi?f} = i{i.r+iir-it-.r} (1.4) 
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Each agent wants to maximize its own pay-off (with this feature the problem differs 
from the usual optimal control problem): 

J,(x)-£;^|^ f,{t,Xt,Vt)dt + K,{T,XT)Y (1.5) 

where E^{-} denotes conditional expectation given Xq — x. In this paper we consider 
only the case in which the state and the source of randomness are one-dimensional. 
The results can be extended to the case in which there are multiple sources of ran- 
domness and multiple controlled states (see |1]). 

Typically in this type of setting the modulating process in Hl.l|) is taken to be 
Brownian motion, i.e., H = 1/2 and the controls of the players are Markovian. Then 
Nash equilibria or other types of solution such as Pareto equilibria are constructed 
using the Hamilton- Jacobi-Bellman (HJB) equations. (See e.g. Friedman ^H], Gaidov 
[El, US, CD Nilakantan 0ksendal and Reikvam "5^, and Pravin |S1|.) However, 
fBm is not a Markov process for any H other than and therefore this approach 
does not work for the general case of 1)1. l|l . Here we will develop a quasi-martingale 
approach to the solution of this problem using the fractional noise calculus developed 
by Duncan et al. |Sj , and 0ksendal and Hu ^3 which generalizes white noise calculus 
(see 1201) to develop an integration theory with respect to fBm. The key to our 
solution will be the fractional Clark-Ocone formula developed by 0ksendal and Hu 
|17|. The integrals in (|1.1|) are Wick type integrals (see Definition I3.3|l rather than 
Stieltjes integrals (defined pathwise; see e.g. |35j)- The motivation for using Wick 
type integrals is as follows: The pathwise integral fsSB^ with respect to fBm does 
not in general have zero mean, i.e. E ^J^^ fgSB^^ ^ 0. However the Wick type 

integral fsdB^ has zero mean, i.e. E | fsdB^^ = 0. Therefore in a stochastic 
differential equation (SDE) of the form 

dXt = b{Xt)dt + a{Xt)dBf, (1.6) 

the volatility term a{Xt)dB^ does not contribute to the mean rate of change, as it 
does in SDE's defined by pathwise integrals. Since seperating the random fluctuations 
from the mean rate of change is desirable for our purposes, we prefer to use Wick 
type integrals for defining the integrals with respect to fBm (see W). (Note also that 
only in the Wick type calculus are the standard tools of Ito calculus, such as an Ito 
representation theorem, available.) See [HI for applications of Wick calculus to pricing 
weather derivatives, and |H] and ^7] for further applications of Wick type calculus 
particularly in finance. 

Fractional noise calculus reduces to white noise calculus when H is replaced by 
1/2. Moreover the integrals of adapted processes in this framework are equal to the 
Ito integrals of these procesess with respect to Brownian motion. Hence our results 
hold in particular for the standard framework, i.e. when the modulator is a Brownian 
motion, and the integrals in 1)1. l|l are taken to be Ito integrals. 

This work has an immediate application in finance, to stock price modeling when 
long-range dependence is accounted for in the model. The stock prices are considered 
to be states in this setting while the agents are not price takers, i.e. their trading 
change the price level. This models a market with institutional investors who make 
large transactions and therefore influence prices. These investors find themselves in a 
random environment due to the existence of small investors. The small investors are 
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typically inert, that is they do not trade for long time intervals. A micro-structure 
model taking the inertness of the agents into account is constructed in % ■ It is shown 
that the prices arising from the interaction of the small agents can be approximated 
by geometric fractional Brownian motion. The game theoretic setting in this paper 
is an extension to the results of 2 in the sense that, we start by assuming that the 
noise in the environment can be modeled by an fBm differential in the controlled 
stochastic differential equation , which models the noise due to the trades of the 
small investors. 

Another possible application is stochastic differential portfolio games, which are 
studied by Browne in a Brownian motion setting in 7 . This formulation is applicable 
to the analysis of traders who are competing for a bonus, or to fund managers whose 
funds are invested in different markets, and who achieve rewards based on the relative 
performance of their funds. Yet another possible application is in stochastic goodwill 
problems (finding the optimal advertising policy for the maximization of product im- 
age) in advertising when there is more than one good of the same kind in competition. 
(See for stochastic goodwill problems in a stochastic optimal control setting.) 

By adapting the fractional noise machinery, our results will hold for more general 
Gaussian modulators in the state flow dynamics. 

However we state the results in terms of fBm to emphasize the fact that the 
game under consideration becomes non-Markovian, and also because this case admits 
an explicit equilibrium. Another motivation for this model is the fact that fBm is 
frequently used for modeling in various areas of research (see 0, |S] for applications 
in finance and [231) 121]) |2H] for applications other than finance). 

The rest of the paper is organized as follows. In Section 2 we give a Nash- 
equilibrium theorem. In Section 3 we introduce the necessary tools from the fractional 
noise calculus that we use in the proof of the equilibrium theorem in Section 4. Finally 
in Section 5 we give a sketch of how to extend the fractional noise machinery to more 
general Gaussian modulation processes. 

2. Nash Equilibrium in a Linear Game of iV players. For ease of exposi- 
tion we consider first a one dimensional state equation, with the drift and diffusion 
coefficients controlled linearly by the players: 

JV JV iV 

dXt = rXtdt ^ a,{t)u,{t)dt + C^I3^{t)v,{t)dt + ^ l3^{t)v,{t)dB" {t) , (2.1) 

2—1 i—1 i—1 

where denotes the one-dimensional version of B(-f^) with Hi = H. The initial 
state will be denoted by ~ x. The pay-off function of player i will be of the form: 

Uo li ii J 

that is, players are constant relative risk averse (CRRA). Here ^ is the measure on 
the sample space under which the canonical process is an fBm. Player i controls the 
state by its choice of actions {ui,Vi). We assume that ai : [0,T] IR is bounded 
for each i G {1,...,N}. The coefficients functions /3i : [0, T] — > H will appear in the 
definition of admissible strategies. 

Since this game is in a non-Markovian setting, it cannot be solved via the HJB 
method. Instead, as noted in Section 1, we will employ the recently developed frac- 
tional Wick calculus, which we describe briefly in Section 3 and the fractional Clark- 
Ocone formula (which is given along with the proof of the equilibrium theorem) to 
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find Nash equilibria for this game. Observe that Ui affects the drift of the state and 
also appears in the pay-off function. It can be interpreted as a cost for the player, i.e. 
for gaining a certain amount of riskless increase the player pays an associated cost. 
Whereas by choice of Vi the player does not have to pay a cost for an associated gain 
(since this action does not appear in the pay-off function) , but it must take some risk 
(since Vi affects the diffusion coefficient in addition to the drift). 

Let us introduce the following notation which is necessary to define the admissible 
strategies and for the statement of the theorem. 

Define K as 

K{t) = , , ^ ^ ' ^ — for t G [0, TV (2.3) 

and define C, by 

((-A)-(^-i/2)c,)(.) = ((-A)-(^-i/2)x)(.s), < s < 



Ct(s) = s < or s > t, 
where the operator (— A)~(-^~^/^^ operates on a test function / as 



{2A) 



where T is the gamma function and is given by T{x) ~ t^^^e^^dt for a; > 0. The 
existence of such ( is guaranteed by [121 . 
Define ft and 77 by 

viT) ^ := exp 1^- j\{s)dB^ - \\K\l^ , (2.6) 

where \K\ i is given by \K\l = /j^2 K{s)K{t)(t){s,t)dsdt, and where 

0(s,t) =i7(2ff- I)|s-<|2-f^-2. 3,11^^+. (2.7) 

Here denotes the probability measure under which is an fBm with Hurst pa- 
rameter H . Note that integrals of deterministic functions with respect to (w.r.t) fBm 
are well defined, as will become clear in Section 3. 

And finally define p by p(t, w) := £'p{77(r)|jFf }, where Tt is the cr-algebra gener- 
ated by {Sf ,s < t}. 

Now we will introduce the solution concept of Nash equilibrium in our context. 
We consider a set = ^1 x ... x y^jv of admissible strategies for which the admissibility 
conditions are adaptedness w.r.t. the filtration generated by fBm and the following 
integrability condition 

P^V, e CYifL), (2.8) 

where £j,'^(/t) denotes the completion of the set of all Tt adapted processes / such 
that 

II / \\cY(f.y= Ef, y^J^ f{.s)f{t)cj)is,t)dsdtj+Ef, | Q^Df fis)ds^ | < 00. 

(2.9) 
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Here DfF = J^(j){s,t)DtFdt, where DgF denotes the Hida-MaUiavin derivative of 
F, which will be introduced in Section 3. 

Definition 2.1. The strategy z'^ = (u'^^v'^) Cz A is called a Nash- equilibrium 
strategy if, for each i, player i 's action zf = {ui, Vi) G Ai is a best response to its 
opponents, i.e. 

Ji {^17 ---T ^ii z'^) < Jf{z'^), (2-10) 

for all X, for each player i and for all Zi €z Ai- 

Then we have the following Nash equilibrium theorem: 

Theorem 2.2. Consider the game given by \2.1]) and 1^2.^) . Then the following 
conditions f h2.11]) . I\2.12^) ) are necessary and sufficient for the existence of a Nash- 
equilibrium: 

fori^l,...,N, and (2.11) 



J2 / m^br'a,{t)^e-'-*^exp(-—^\CtUdt 
tiJo V2(l-7.) ; (2.12) 



+TO"' ~i e ^ 1 exp 



2(1-7')' 

has a solution m* G H. 

Let ((m^, w^), (u^, w^)) denote the agents' Nash- equilibrium strategies. The 
first components of the equilibrium strategies are uniquely determined by 

u^At)^('^^^^-^^e-^'p{t,w)Y'\ for^^l,...,N, (2.13) 



while the second component of the players' strategies will be any adapted (to the fil- 
tration of fBm) processes satisfying the following constraint: 

{s)ds 



e-^*EA<(0 = (™*)^^exp(^^ K{s)dB?--^j^ K{s 

\K\l - y^\KMo.m\1 - rT-J-^j -j^Y. -du)^i- 



2(1-7^) 



1 - 7i V 1 - 7» Jo 1-7^ 

2-7^ ,2 1 
2(1-7.) 



(2.14) 



where 1 stands for the indicator function. Finally, the state at time T at Nash equi- 
librium is given by 

F" = (m*)7^77(T)v^e^. (2.15) 



6 



ERHAN BAYRAKTAR AND H. VINCENT POOR 



These results can be extended to games with muhiple numbers of controlled states 
and multiple sources of randomness (see 0]). 

Before proving Theorem 12.21 we will, in the next section, give a brief review of 
basic results from fractional noise calculus, mostly following the treatment by Hu and 
0ksendal ^7]. (An extended version of the following section can be found in 4 .) ^ 

3. Fractional Noise Calculus. We will start this section by introducing the 
necessary ingredients for the definition of the the stochastic integral in . In what 
follows (R) will denote the completion of the set of measurable functions satisfying 

\f\l-^ f f{s)fit)(Pis,t)dsdt<^. (3.1) 

Remark: It is shown by Taqqu and Pipiras [301 that the set of functions satisfying 
l|3.1|l is not a complete space. 

The stochastic integrals of deterministic functions in L|(IR) w.r.t. fBm are well 
defined (see ^Jj). For / € i^(IR), we will denote its integral w.r.t fBm by < w, / >:= 
/„/(i)di3f. 

The probability space in our game will be 17 = S'{R), the space of tempered 
distributions (the dual space of 5(]R), the Schwarz space of rapidly decreasing func- 
tions) equipped with the weak-star topology. And we will take the events to be Borel 
subsets of S'{R). By the Bochner-Minlos theorem there exists a probability measure 
fj, on Q such that, < ■ , f >: Q H is a Gaussian random variable with mean 0, and 
variance l/l^ (see [T7)'). 

We will now introduce the Wiener chaos expansion of random variables in (/i) . 
We first must find the orthonormal basis for L^(R). Recall that the Hermite functions 
(see e.g. Appendix C of |15p. which we will denote by (zn), form an orthonormal 
basis for L^(R). 

Let us define the map from the space of functions satisfying 1)3. l|l into (H) by 

/•oo 

{I^f){u) = CH {t-u)"-'if{t)dt, (3.2) 



/ H('2H l)rf 

where ch — J r{H-^)r{2-2H) O^^^'^j before, F denotes the gamma function). This 

map preserves the inner product, and the Hermite functions are in the range of this 
map. Let I^^ denote the inverse map of J^. (For sunimable functions this inverse 
exists and is proportional to the Liouville differential of order H — ^ since I^{f) 
is proportional to the fractional integral of / of order H — Now we see that the 
set (e„ — I^^{zn))n=i,2,... constitutes an orthonormal basis for L^(]R). 

Let J' denote the set of all (finite) multi-indices of non-negative integers. Then 
for a — (ai, q;2, a™) G J', define 

Haiw) := ha^{< w,ei >)...ha^{< w,em >). (3.3) 

Note that E^{HaHi3} = if a 7^ /3, and E'^jiJ^} — a\. Now we can state what 
is known as the chaos decomposition for the elements of L^{fi) (see JT]): Every 

^Although the original name given by Hu and Oksendal in 1171 to this kind of calculus was frac- 
tional white noise calculus, we prefer to omit 'white' from the name since white suggests independence 
at each point in time, and here the noise considered does not have this property. 



A NON-MARKOVIAN STOCHASTIC DIFFERENTIAL GAME 



7 



F e ^^(m) can be decomposed uniquely as F{w) — J2aeJ '^aHa{w) where Cq. G R for 
all a e J. 

For defining the integration w.r.t fBm of random functions we will make use of 
the Hida test function space (a subspace of L'^{fi)), and Hida distribution space (a 
superset of L'^ip)) which we denote by {S)h and (5)^ respectively. (See [^Hj for the 
definitions of these two spaces.) Let il}{w) — J2aGj '^aHaiw) £ {S)h and G{'w) = 
S/3ej b/sHp^w), and denote the action of G on by << G, ip >>:= X^aej- ctluaba- 

For defining the integral w.r.t fBm it is necessary to define (5)^-valued Pettis 
integrals as follows. 

Definition 3.1. A function Z -.R^ {S)'^ is (5)^ integrable if << Z{t),^jj »e 
L^(R) for all G {S)h- In this case, the (5)^ integral of Z , denoted by Jj^ Z(t)dt, 
is the unique element in (5)|^ such that 

« / Z{t)dt,i;»= / «Z{t),i;»dt, for alliP e {S)h- (3.4) 

Remark: t — s- Bp is differentiable in {S)*fj, i.e. fractional noise is a well-defined 
object and we denote it by {W^). 

Below we describe the Wick product which is the last ingredient necessary for 
describing the integration w.r.t fBm. 

Definition 3.2. Suppose F,G e (5)^ are given by 

F{w) = a^Haiw) and G{w) = ^ bpHfjiw). (3.5) 

Then the Wick product F o G of F and G is defined as 

iFoG){w)^ J2 a^bpH^+p{w). (3.6) 

Remark: {S)h, and (5)^ are closed under Wick product. 

The Wick exponential exp* is defined as exp*(X) = X^^^o^TTT' provided the 
series converges in (5)^, where X^" = X o ... o X {n factors). And we have that 

exp* (< wj>)= exp [<wj> -^\f\l) , for / e (R) (see HZ]). 

Definition 3.3. Suppose Y .H^ (5)Jj is such that Y{t) o W^^ is integrable in 
(5)1^. Then J^Y{t)dBl^ is defined by 

[ Y{t)dBP ( Y{t) o W^dt. (3.7) 
Jr Jr 

Lemma 3.4. Let L^ip) be as in lOj) . IfY e C^ilj), then J^ YtdBf exists as 
an element of L'^^ji) and its norm is given by \\ Y ll^i,^^^^. 

For finding the equilibrium strategies we also make use of the Hida derivative 
(which is called the Malliavin derivative in the context of Wiener space) which we 
will define below. We first define the directional derivative: 

Definition 3.5. Suppose that F : S' ^ Ji and 7^5'. Then the directional 
(Gateaux) derivative of F in the direction of j is given by 

Fiw + ei) — F(w) 
D^F{w) lim ^ if it exists m {5)}^. (3.8) 
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Definition 3.6. F : S' H is said to be differentiable if there is a map if : R — > 
(iS)Jf such that 

K{t,w)j{t) is {S)*ff integrable 

f (3 9) 

and D^F{w)= / K{t,w)j{t)dt for all j e L'^(R). 
Jr 

Then DtF{'w) :— K{t,w) is said to be the Hida derivative of F. 

We will make use of the PothofF-Timpel test functions and distributions (see (31] for 
the definitions of these objects) to define quasi-conditional expectation in the following 
sections. We denote these spaces by G and Q* respectively. The Hida derivative of 
the random variables in Q* exist. 

Let F ~ (^aHa{w) E Q* . Then the Hida derivative exists and is given by 

DtF{w) = 51 E "'^"-e- He^{t), (3.10) 

a i 

where — (0, ...,0, 1,0, ...,0) with the 1 in the ith component. 

We proceed by defining the quasi-conditional expectation and then introducing 
the fractional Clark-Ocone theorem which will be crucial in reducing the dynamic 
optimization problems of the next section into static optimization problems. 

Definition 3.7. fT7y If F e Q*{^^) has the following expansion 

= E / fnidB^r^", (3.11) 
then its quasi- conditional expectation is given by 

CO „ 

MF\^t}^y2 /n(rfi?^)^". (3.12) 

Note that Efj,{F\j^t} 7^ £^^{-^1^-"*} in general. (Only for = i is the quasi- 
conditional expectation operator the same as the conditional expectation operator on 
L^(^).) However the following holds: £^{^1^4} = a.s. F is measurable. 

The following feature of the quasi-conditional expectation will be helpful in the 
computations in the next section: 

E{FoG\Tt}^ E{F\Tt}oE{G\Tt} fovF^GeG*. (3.13) 

We will also need the notion of a quasi-martingale which is defined as follows: 

Definition 3.8. Suppose Mt is an {Tt) adapted process in Q* . It is called a 
quasi-martingale if 

E{Mt\Ts] = Ms, for all t > s. (3.14) 



Lemma 3.9. fWf Let F e £;^'^(^). Then Mt — F^dB^ is a quasi-martingale. 
Now we can state the fractional Clark-Ocone theorem. 
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Theorem 3.10. [Hjj Suppose G{w) e L'^{^J-) is Tt measurable. Define ii{t,w) = 
E^[^DtG\j-t} , where D^G is the Hida derivative of G at t, which exists as an element 



ofG*{ij). Then & £^ (/i) and 



■ T 



G{w)=Ef,{G}+ ip{t,w)dB^ . (3.15) 



4. Proof of Theorem 12.21 Recall that in Theorem 12.21 we consider the one 
dimensional state equation (|2.1I) where the pay-off function of player i is of the form 

As noted previously, we will employ the fractional Clark-Ocone formula and the 
Wick calculus introduced in Section 3 to find Nash equilibria for this type of game. We 
begin this development by stating a fractional version of Girsanov's theorem, which 
is given by (17) . 

Theorem 4.1. Suppose T > and u : [0,T] ^ R is continuous. Suppose 

further that K : [0, T] — *■ H satisfies the equation 

T 

K{s)(P{s, t)ds = u{t), 0<t<T, (4.1) 

where <p is given by {2. Tj ). Extend K to m by putting K{s) = outside [0, T]. Define 
the probability measure /t on Ft by 

Then = u{s)ds + , is an fBm with respect to jl. 
The dynamics of the state ()2.1|l can be written as 

N N 

d(e-''*Xt) - e-''* ai{t)ui{t)dt = e"''* ^ f3^{t)v,{t){Gdt + dB^). (4.3) 



i=l 



Let 77 and fi be defined as in (|2.6|l : i.e., 



exp* 



£ K{s)dB^-^\K\l^ 
-j\{.s)dB^y 



(4.4) 



where K is from H2.3|l . Then since K solves H4.1II for u{t) — C (see Appendix Lemma 
I7.1|l and by the fractional Girsanov formula, the process 

B^^Ct + B^, (4.5) 

is an fBm with respect to /t having the same Hurst parameter as the modulating 
process in (|2.1fl . Thus, the differential equation describing the flow of the state is 
given in terms of B^ as, 

e-'-'Xt - / e-^'y^a,{s)u,{s)dt = x+ / e-^'y^P,{s)v,{s)dB^ . (4.6) 

JQ Jo 
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To be able to find a Nash equilibrium, we will use the quasi- martingale approach 
to stochastic control in the proof. (For another application of this approach see \l<i\.) 
We first find the best response of a player to the given strategies of other players, and 
for that we will use the fractional Clark-Ocone theorem fThm IXTUI) . 

By (ESJ we have that e'^'^Xt - /q e"''^ X^^i S L^ifi). And note 

that by Lemma IX^ and (|2.8|) . Jq e^^'^ J2iLi f^ii^)^i{^)dB^ , is a quasi-martingale. 
Therefore we have 



/■* _ ^ 1 

Jo ^=l J 



Now let G be given by 

G^e-^'^F,- / e"" Vaj (s)Mj (s)ds. (4.7) 

Assume G G £^(/i). Then if 

Ef,{G} = X, (4.8) 
by the fractional Clark-Ocone formula H3.15|l we have 

G^x+ [ Ef,{DsG\j^s}dB^. (4.9) 
Jo 

If we choose Vi in H4.6|l such that 

v.is) = , (4.10) 

then from 14.9|l we see that Xt — Fi. 

By the above argument we can change the dynamic optimization problem of 
maximizing p.2() under the dynamics (|2.1|l into a static optimization problem. In 
particular, given the other players' strategies, player i wishes to solve the following 
maximization problem: 

K,{x) = sup IeJ r ^^^^^^dt + 1 ; given that 



e-''"^aj(s)Mj(s)ds-He~'^^F,| (4.11) 



where the supremum is taken over Fi and (u^) such that 



e-^'^F,- e-'''y^aj{s)uj{s)ds(^L^{fL). (4.12) 
■^0 



This optimization problem can be solved by first considering for each Ai > the 
following unconstrained problem. 



Ui,Fi 



M 


[i 







dt + }+\,eA- e-"-' V a, (s)u, {s)ds + e''''^ F, 

li Jo 



3 = i 

(4.13) 
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and then solving for from the slackness condition: 

e-''''Y^^aj{s)uj{s)ds + e-''^F.)j =x. (4.14) 



Let us define, as before, the following random variable 

p{t,w)^E^{Tj{T)\Tt}, (4.15) 
where rj is from H4.4|l . Using the fact that 

E^{r^{T)u,it)} = E^{p{t)udt)}, (4.16) 
we can solve (|4.13|l by maximizing pointwise, i.e. for each t and w, the functions, 

9^{u^) ^ ^ - Kp{t,w)e-'^'y^a,{t)u,, (4.17) 



and h,{F,)^^^-X,7^{T,w)e-^^F,. (4.18) 

Since < 7^ < 1, these functions arc concave, and therefore we can solve g'i{ui) — 
and h[{Fi) = to find the maximizing points, which are given by, 

„.(,) = (M!iif!)fr!*w)*, ,4.19) 



Since ai{t) is bounded by assumption, H4.12|l is satisfied. Note that at the Nash 
equilibrium Fi is independent of the player index i, i.e. Fi = F'^ for all i. We will use 
this condition to show that the Lagrange multipliers at the equilibrium are necessarily 
linear in bi and then use the slackness condition to actually find their values. First 

we will find \ri{T)'^ I. Note that 



(4.21) 

Since £; | exp* M /(s)dBf j I = 1, (4.22) 
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Elr^irri-^ \ = exp ( J t,, \K\l ] . (4.23) 



for all / e L?{lj)^ we have 

V2(1-7D^ 
Therefore using H4.2(J|I we obtain 

It follows that 

= E{F,} exp* 1^^^ Kis)dB^^ . (4.25) 

From (|4.25|) we see that for a Nash-equilibrium to exist we necessarily have 7^' — 7', 
and Xf — mbi. From Q we see that m is to be found from the slackness condition: 



M I ^-^v(t)(E..(i) ( -^'^^^^; "^^y - )^t+e-^(T) [^^^^^y } 

(4.26) 

Note that by we have the following 

£|,(T)v^|=exp(jpI^|Al5), (4,28) 
Using Thm. 3.2 of 16 p{t,w) can be written as 

P{t.w) = exp - j\t{s)dB^ - ^ICtll), (4.29) 



(4.30) 



where Ct is given by the following: 

((-A)-(«-V2)c,)(.) = ((-A)-(^-V2)x)(,), < s < 
Ct(s) = s < or s > t, 

with the operator (— A)^^^^^/^) on i^(^) defined by ()2.5|l . 
Thus 



vl-7^yo "'"'^"^ 2(l-7.)2'^^'^' 2(1-70'^^'^' 2(l-7.)2 

(4.31) 

from which we conclude that 



E 



{p(t)^}=exp(^^^^^^|CtU), (4.32) 
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so that m can be solved from (|4.26|l . which leads to the following equation: 

^ / m^6--^a,(i)^e-'-*^exp(— ^^|CtU)di 

-1 " (4.33) 

_,T^ ^ 27'|if|, 
-1 e -1 exp 



2(1-7')' 



After solving for m using (|4.33|) . then by H4.19|l and H4.20|l we have the final state at 
the equilibrium and strategy Ui for player i leading to that state, given respectively 

by, 



and 



F" ^m^'q{T)'=^e^, (4.34) 



um-{'^^^^e-^'p{t,w)Y~\ (4.35) 



Observe that these controls are not Markovian. (In a Brownian motion setting the 
controls were assumed to be Markovian at the outset so that the HJB equations for 
an equilibrium solution can be developed [7|, and PHI-) 

Now we will proceed to find (vi) at the equilibrium, which is the second component 
of the players' strategies. For this we will again make use of the fractional Clark-Ocone 
formula. 

Suppose is given by 

G'^^e-^'^F^- e"" Va,<(s)ds. (4.36) 
Since there is a unique adapted process ^{t^w) such that 

Jo 



(4.37) 



which, from the Clark-Ocone formula, is given by 

iP{t,w) =Ef,{DtG'\Tt}, (4.38) 
it can now be seen immediately that any adapted (vf) that satisfies 

N 

^^AG^I^t} =e-'-*^A<(t), (4.39) 

i=l 

is an equilibrium strategy. 

To obtain a more explicit expression, we will compute Efi^lDtG'^lJ-t}. Using (|4.34(l 
and (|4.35|) . G^ is given by 

^ ^ ~ ^m6,:\^^ -rt 



e -li-^ p{t,w)~ 
(4.40) 
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To calculate the quasi-conditional expectation of the Hida derivative of we will 
first find it for the stochastic part of the first term on the right-hand side of (|4.4U|) . 
Define R as 



^ = cxp ( TT— 4 - / K{s)ds ] . (4.41) 



Using the chain rule, 1)4. 5|l and 13.12|l . we have 



1-7 V 1 - 7 Jo 



1 — 7' 



(4.42) 



Now we will find the quasi-conditional expectation of the Hida derivative of the 
stochastic part of second term on the right-hand side of 14.40|l using (|4.29|) . I.e., 

E^\Dt{e-^-^^ p{u)^)\Tt^ = 

f^^e-^"^ exp {-^ f U.^)dB^ - r Us)ds (4.43) 

1 - 7i: V 1 - 7i Jo 1 - 7i 

o7i ^^^K"!* ~ ICtil[o,t]l0 

2(1 - J^y ^ l-Ji ^ ' ^ 

Using (|4.39|l and 14.40|l we have the result for the second component for the 
players' equilibrium strategies, and this concludes the proof of Theorem 12. 21 □ 

5. Extension of the Wick Calculus to Arbitrary Gaussian Processes. 

Although the results of the preceding sections have considered the explicit case in 
which the modulator in p. 1(1 is fBm, these results can be extended to the situation 
in which the modulator is a more general Gaussian process within sufficient regu- 
larity. This requires the extension of the Wick calculus to more general Gaussian 
processes. In this section, we sketch how this extension can be accomplished. The 
first step in extending the fractional noise machinery introduced in Section O to more 
general Gaussian processes is the following theorem due to Loeve for integrating 
deterministic functions with respect to second order processes : 

Theorem 5.1. (\EM) Suppose that X is a zero-mean process such that E{X^} < 
GO for all t, and denote its covariance function by R. Then, for —oo < a < b < oo, 

b 

f{t)dXt (5.1) 
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exists as the -limit of Riemann sums if and only if 

\f\l f [' f{t)f{s)d^R{s,t) < oo. (5.2) 



Henceforth X will denote a Gaussian process. By the Bochner-Minlos theorem, there 
exists a unique probability measure on the space of tempered distributions such that 
<-,/>:f2— s-Risa Gaussian random variable with mean 0, and variance |/|^. 

We will denote i^(/i) by L'^{X) and H{X) will denote the linear space of X, i.e. 
the closed subspace of L'^{X) spanned by Xt for all t £ [a,b] {i.e. the first Wiener 
chaos). As in 'TW we construct A(i?), a Hilbert space of deterministic integrable 
'functions' isomorphic to H{X) by completing the pre-Hilbert space of step functions 
S with the following inner product, 

<f,9>s= 1 1 f{t)g{s)d'R{t,s), (5.3) 

for any f,gCzS. Then the integration operator defined on the set of step functions 
(the integration with respect to X) can be extended to an isomorphism between H{X) 
and A{R). (The elements of A(i?) are generalized functions, i.e. distributions |3U| . ) 

As a second step we will define the Wick-integrability of a random process with 
respect to a Gaussian process. This is done by using the tensor product structure of 
the space L^(X). Let us define the tensor product of Hilbert spaces. 

Definition 5.2. The algebraic tensor product Hi ® H2 of Hilbert spaces Hi and 
H2 is a pre-Hilbert space with the following inner product 

< hi(g) h2,gi ®g2 >Hi®H2-=< hi,gi >Hi< ^2,52 >H2, (5.4) 

for gi, hi G Hi and i = 1,2. The closure of this pre-Hilbert space is the tensor product 
of Hilbert spaces, which will still be denoted by Hi ® H2. Hi®H2 will denote the 
symmetrized tensor product. 

Then we have the following Wiener chaos isomorphism theorem. 

Theorem 5.3. f^) (Bp>oH®P{X) is isomorphic to L^{X) with the unique 
isomorphism $ defined by 



$(er^^...®er^) = ^n/i„,(o), 



(5.5) 



where ^i € H{X) for all i are orthonormal; p — \a\ — ai + ... + ak . Here hn is the 

Hermite polynomial of degree n (see ^15), Appendix C ). 

Note that for a random variable ^ G H[X) with unit variance we have 

$(e®«)-exp(^e-^), (5.6) 

where the exponential is defined by e®^ — X)p>o 

We proceed as in and in order to define the integral of a stochastic process 
with respect to A", we first define a tensor product integral, denoted by J (g) dXt, 
and its domain, denoted by A(i?)^2(-x). 

Suppose §L2(x) is the pre-Hilbert space of the L'^{X) valued step functions Ft, 

N 
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for (^ijtj+i] e [a, 6], and e L'^{X), equipped with the inner product 

<F,G>= [ j <Ft,Gs>L-{x)<PR{t,s). (5.8) 



Let K{R)l^2^x) denote the completion of §l2(x)- For the F e §l2(x) given in ()5.7|l 
define the integral as 

N 

Ft®dXt=Y,Fu®{Xu_^,-Xu). (5.9) 
i=i 

Since this integral is a norm preserving linear map, it has a unique extension to an 
isomorphism from A(i?)^2(x) into L'^{X) ® H{X). We will construct a map from 
L'^{X) (g) H{X) into i^(X) and call the composition of the two maps, ^'(/^), the 
stochastic integral. We start by defining the following linear map 

^p-. H^P{X)(»H{X) H^P+\X) (5.10) 

by 

p ((ef "^^...^er") ® 6) - (p + 1)^^!®"^®-®^!"'®^^ (5-11) 



where (^i) G H{X) is an orthonormal set of random variables, and ai + ... + ak = p. 

^'p can be extended uniquely to a bounded linear map with norm [p + 1)^/^ from 

H^P{X) ^ H{X) onto iJ®P+i(X). 

Now define ^* as the map from ®p>oH'^P{X) (g) ir(x) onto ®p>iH'^P{X); by 
= ffip>o*p, viz. the restriction of v]/* to H^p{X) ® H{X) is ^fp. The domain of 

the operator ^* is given by 



V* 



{77 e (i/^"i(X) © ... © iJ®"'"(X)) ® ff(X) : ai + ... + a,„ < c3o} , (5.12) 



so that X]p>o < where ry^ is the projection of ry on H®p{X) ® H{X). 

By Thm. O ®p>oH^P{X) is isomorphic to L^(X). Therefore (^®p>oH^P{X)^ ® 

H{X) is isomorphic to L'^{X) (g) H{X). Denote this isomorphism by $o- Let T) = 
$0(2?*), which is a proper subset of L'^{X) ® H{X). Then define * by 

* = $o^'*o$-i. (5.13) 

We define the Wick product of F G L'^{X) and W G i7(X) as 

V oW -.^-^{V ®W). (5.14) 

Note that V oW L^(X) ®W (^V ® H{X). 
The integral jFfO dXt is then defined by 

/ FtodXt^-i'oI^iF) (5.15) 

for aU F such that /®(i^) = / i^t e P. The set of all F's in the domain of 

integration is denoted by A(R)*j^2(^x)- Then we have the Ito representation formula as 
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a result of the Multiple Wiener Integral (MWI) representation of the random variables 
in L'^{X) ( 19 ), and the fact that each MWI can be written as an iterated integral: 
Theorem 5.4. ffW/] Every 6 £ L'^{X) has the following representation 

e = E{e}+ I FtodXt, (5.16) 

for an F £ A(i?)22(x) ^^'^^ cidapted to the filtration generated by X. 
Now let us define the Wick product of two elements in L'^{X). As a first step we 
define T„ 



Tp^g : H^P{X) (g) i?®«(X) ^ H^P+i{X), (5.17) 



as 



T 



(5.18) 

for any (^-y) that is an orthonormal set in H{X). 

On denoting T — ®p>o ®q>o 'Tp,q, we define the Wick-product of the W,V £ 
2.2 (X) as 

WoV ■.= <P{T {'i>-\W)(g)<i>~^{V))) . (5.19) 

Note that L'^{X) is not closed under o, since the tensor product of the random vari- 
ables may not be in the domain of T. Then one can define the Hida distribution 
space, use H5.19|l as the definition of the Wick-product over this space, and see that 
the Wick product so defined is closed over these spaces. 

The main machinery we use to develop strategies leading to a Nash equilibrium 
are the Girsanov formula (the absolute continuity of the translated measure w.r.t. 
the original measure), and the Clark-Ocone formula. These can be extended to more 
general Gaussian modulators with sufficient regularity. The Girsanov theorem, Thm. 
14.11 can be stated for an suHiciently regular Gaussian processes. (The proof of the 
Girsanov theorem in does not make use of the explicit expression for (fi.) The 
derivation of the Clark-Ocone theorem (Thm. 13.10(1 is done by using only the tensor 
product structure of the space (Thm. I5.3|l and the spaces of generalized random 
variables. Defining the Hida derivative and the quasi-conditional expectation operator 
(w.r.t. which X is a quasi-martingale) for the Gaussian process X, we can restate the 
Clark-Ocone theorem. Now replacing (t in Thm. 12.21 bv i?t such that 

Ms)dX,, (5.20) 

we have a Nash equilibrium theorem for a general Gaussian process. Note that, unlike 
the case of fBm we cannot in general write •& explicitly in terms of K. Hence, we can- 
not give an explicit solution for the Nash equilibrium. A general multi-dimensional 
theorem can also be restated for a multi-dimensional Gaussian process with inde- 
pendent components (the components do not have to be identical) by making same 
conceptual modifications as in the one-dimensional case. 
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6. Conclusion. In this paper we have explicitly found Nash equilibria for stochas- 
tic differential games in a non-Markovian setting. In this formalism, all the agents 
observe the states, and they control the states by modifying the drift and the volatil- 
ity. The agents are heterogeneous in their controls and utility functions. We have 
taken the modulating process to be fractional Brownian motion, because an fBm is 
versatile in modeling long-range dependence phenomena in finance and networks. 

Since the diffusion in our model is modulated by a non-Markovian process, the 
usual technique of finding Nash equilibria via Hamilton- Jacobi-Bellman equations is 
not available. Therefore we have made use of the fractional noise calculus to calculate 
the agents' Nash-equilibrium strategies. Although we have taken the modulating pro- 
cess of the diffusions to be fBm, our results hold for more general Gaussian modulating 
processes with only slight modifications to the white noise machinery. 

Our results are applicable to financial markets in which stock price dynamics are 
modulated with fractional Brownian motion. One of the candidate applications is 
stock price modeling when each agent's activities in the market affect the price flow 
(institutional investors are such examples), or if there are transaction costs. This 
work is also applicable to stochastic portfolio games, in which agents compete for a 
bonus. 

7. Appendix. Lemma 7.1. ff^) Let f : [0,T] ^ M be a continuous function 
and introduce the following integral equation: 

T 

f{sms,t)ds^ f{t) forte^n (7.1) 



where (j> is given by {2.7}) . The solution to this equation is given by 

fit)^-^t-2-"4- r dww'"-\w-t)-2-"4- r dzz-^-"{w~z)---"f{z), (7.2) 
dn ds dw Jq 



.3 „A^..„ . 1, 



where 

dH^2H{2H-l)i^rq-H)j T{2H-l)cos{TT{H-p) (7.3) 

Corollary 7.2. // we take f(t)=C on [0,T] in the integral equation given by 
\7.1^ then the solution f{t) is given by 

f(t) = -^ti-"{T-tf^-", (7.4) 

where 

kn = 2H{2H - l)r(2 - 2H)T{2H - 1) cos{tt{H - i)). (7.5) 

Proof: The proof can be found in Tf, but we present it here for the sake of com- 
pleteness. 

/>) =--!-Ct^-^4 C dww^"-\w-t)'-"4- r dzz---"{w-z)'-". (7.6) 
dn ds Jt dw Jq 

Note that 

J-zi-"iw-z)^-"dz 3 3 TH-hY 

w2-2ff 4' 2^ T{3-H) ' ^ ' 
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where B{-,-) is the beta function given by 

B{x,y)= f e-\\-t)y-Ht. (7.8) 
Jo 

Hence 

Using (|7^ it is not hard to evaluate ifT?^ to get ifT^ . □ 
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